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ABSTRACT 

Treatment verification methodology was employed i 
studying the Chicago Child Parent Center (CPC) compensatory educ= 
program. Established in disadvantaged areas by the Chicago public 
schools^ CPCs are designed to break the cycle of poverty through 
educational intervention with children at ages 3 through 3, An 
element of evaluation studies that include experimental designSf 
treatment verification is the rigorous documentation of tha degre 
and/or type of implementation of an intended treatment. I- this 
study^f U3 classroom observations were conducted by 22 observers i 
randomly selected CPC and control classrooms in order to verify t 
CPC treatment differed significantly from conventional tz^ztmenz 
that CPC treatment was being implemented as intended and z:^ test 
hypothesis that program outcomes resulted from differences in pro 
treatments To delineate CPC program processes^ four scales ^ere 
composed from the Classroom Observation Rating Scale (CORS) • The 
scales were titled Enriched Environment, child-cent eredness , Pare 
Involvement and Presence of Evaluation of Student Achievsoasnt • In 
addition, parent involvement was assessed using salx-reports fron 
parent interviews. Relationships and variables were examined usin 
analysis of variance, multiple regression, discriminant fuictions 
analysis and factor analysis. Among the results, findings indicat 
that children in CPC classes scored higher on all intended proces 
but only the ::hild-centeredness and evaluation scales show=2 
statistically significant differences. (Author/RH) 
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t::1.oreticai background 



Tr- : :i r' ::eajr.-::i empi: -reatmen^ verification methodolcgy in 
stud:-" 'ug Caicago Ch - ^arent Center compensatory education program. 
"omp^ii:.:>atr y education | "grams are rrograms intended to overcome the 
ill "iffecu.: ?t economic de:rivation. Compensatory education programs 
have, cr iirs h-^en stu__-::d before most notably, the Head Start 
:)ro^ ',-£3 Ll; v /o Low Thr „_5h progri . 'l.-a major evalu£ition of Head 

."_ar <:a^ co: ;i3sio"ed v Office :: .::ioniic Opportunity in 1963 and 

-.3 . :;oa- ^ - a We5':in^i-L3:^b€:;/0hio Univ ^ i~y Report (Cic .relli, et al . , 
.-'-Jo' - '''he ~ ::5ulr::: of report were nerally negativ e insofar as the 

evr- . lulled to estal: li:i:h any subst . uia: cognitive gci ..:is a 

" P'- va^. • - '^ ir:; icip iizicn . The '\^es~:inghouse ev£ on 

...^..^:i~c ihi' effe". : i: s progri:~:. full year progr. Head 

5 . iciTt ^c_Tx^r.iif. snc nc'--^ licipant ...i-e compared in ea: ;f grades 
1 _ r.d .1'- ip-i'c :i^ fiTidix.^;^s were as -low: 

— si^.-fica:.c df ffc ■:es were f2:ir:a . -rr.tween summer pi ■ ^ram 
pir ' '^mts and coz r:ls ar any grade level. 

— :iill > -ar Head Starr participants were :ut-per formed by controls 

i\- .i( iLropolitan ".eadiness Test by £ .^mall but stati^snical ly 
i^^r. . } z-ir.t anouni. 

— lr.-'^':e %■ ro sigr-ii^ ^ant differences : scores on the 

Sr-- fo^ i Severn nt Test at the beginr. „ng of grades 1 and 3. 
—No c ■ ren :S were found in children^: self -concept or in teacher 
r;'- of lassroom behavior for Head Start vs. comparison group 

chilc7^^:. 

These fzrzr:^: . began a continuing discussion of methodology in 
evaluating _arr social programs. Many problems flawed the Head Start 



program and its evaluation, but the main problems of concern here are 
that Head Start treatment was poorly specified and that implementation 
of treatment was poorly verified. Head Start Centers had no single 
curriculum. Treatment varied widely from one center to another. Most 
centers had "permissive enrichment" programs, a "whole-child 
orientation," and a low degree of structure. The program developers and 
evaluators viewed this loose curriculum as a kind of ''black box" which 
should have beneficial effects. Because the specification of treatment 
was so vague, it was extremely difficult to give reasons for the 
findings. This lack of explanatory power provided important impetus for 
the development of a methodology for verifying the implementation of the 
intended treatment . 

Treatment verification is the rigorous documentation of the degree 
of and/or the type of implementation of an intended treatmer_t. The 
treatment-control experimental model assumes that the trearr.ent must be 
clearly specified and that implementation of the treatment must be 
clearly verified. If verification cannot be made, inferen^.es regarding 
treatment effects cannot be regarded as valid. To put it another way, 
withou^ reatment verification a finding of "no effect" could easily be 
the iv-ulv )f "no experiment" (Leonard and Lowery, 1979). In program 
eval'.at as, the fact i-^ that the existence of clearly stated program 
goals (the intended experimental treatment) does not automatically imply 
the implementation of those goals (Charters and Jones, 1973). Without 
treatment verification there is absolutely no way to guarantee that the 
intended differences between instructional methods actually did occur 
because of the intended treatment. 

In evaluation literature there has been a growing awareness of the 
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need for treatr.:ent verification because of the inherent '^'^ zies of 
conducting experiments in naturalistic settir.,;3S and the ^ry- lac.c 

of explanatory power. The logic for improvi:.. , che mv;-::: :..,:;ol 
treatment verification may be stated as folic,-, 3: 1) L-:- i»i ich 
e.-nploy quasi-experi.-: :r.-;al designs ii.re desirabl becaj. 
a— empt causal infer -.-ces and provide indicar ; ns of ti.e - 

When the existence of conditions ne::essary for ^ quas. -i-.. r 7 
doubt, the validity of the inferences concern!: ou .cc : 
doubt. 3) A way to ensure more reliable outccr. s is t --^r::^" 
existence of an intended program by way of a quasi-ex: ner.: 
review can serve to demonstrate the development of -h- currre:. . 
of the need for treatment verification in evaluations iplc Ing 
quasi-experimental designs . 

In 1963, Cronbach observed that process measures k: lal 

value in showing how a course can be improved becaus- ,y QX=mLne what 
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happens during instruction. In spite of this, he coi 
studies should be designed ^'primarily to determine t 
performance of a wel 1 -described group with respect U 
objectives and side-effects" (Cronbach, 1963). This ^l. 
a belief that quas i-experiments strong enough to sur./ 
could be conducted in naturalistic, settings. 

Scriven (1967) pointed out how process studies i. 
investigation of causal claims about the process, an 
between formative and summative roles of ev^aluation, 
delineate the significance of process studies in surr — 

Before going further it is important to clarify ::.e 
between treatment verification and formative evaluation 



rhat formil 
our 3e 

jif ~ Indicates 
-:ori' us ions 

: :e 

iistinguished 

16 did not 

■ evaluations . 

St inct ion 

ice both focus 



upon the processeg of the program. As Scriven defines it formative 
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- -n is concernf--d wirh the ongoing improvement of the curriculum, 
rast , Scriven ifines the role r summatiV': eva,>uatio- as: "to 
. : .;hether the en:, re finisner, lurrLculum, refined by us : of the 
/.-.ion process in i-_s firs:, (fc r..: -'■^.) -ole, represents a 
::..3ntly significan: advan:.- or. z\ .-ailabl:-. ilternatives to 

-ly the expense of . ioption by ^.d1 ■^.i ' (Scriven, 1967). 

---.1-- a summative eval uation is b-^ . , :ii specified time limits 

i-^interested outs ie party, f c r- ^ :- - r:-ion involv=-:js c: kind 

c'--inuing partnershi.j betvreen the -urrir - -3valuator and the 
: :-:-lum developer, a partnership ie.. ir^e ~o izevelop and improve' the 
-icuium. The goal of a formative eva ■. ..on :iil usually be to 
■'^ Lfy that the intended program is acti^l^:. ' be.i?_g implementec and not 
-r;:ssarily to determine whether the imi: ?,mente. program is an 
rovement over the old program. 
Summative evaluation views the curr :ulum as already "developed'* and 
L esses its effects as a finished product. The role of th*^. summative 
-luaticn is not to develop a progra but to determine how the program 
: its particular manif esrat ion compa~fiS to conventional programs. In a 
sumnative evaluation, the study of th program *s processes is not 
primarily intended to promote an impr^ ement in those processes but 
rather to provide an explanation of c an accounting for the summative 
findings; i.e. to verify that there a^iually was a quasi-experiment . Of 
course, the findings of the treatment . --ification may be used to 
improve the program, but they may also Reused as a rationale to 
discontinue the program or to increase c - decrease implementation of the 
program as it is. Although the formativ- summative dichotomy is useful 
conceptually, the neat distinction between formative and summative 
evaluations breaks down in actual pracri.::e, where elements of both 



evaluaii>^ zypes usually co: into play. Stri;: • srea,-;ing, ther- is no 
such t: .. as a summative, : the sense of "fir.^ evaluation. very 
evaluar on should contribuze no forming better ' f :: Ams . TreatiT;-- .t 
verifi: can be vieve a? the study of proc / n a ■'summati- " 

evaluat:. .hose purpose r.ot merely to provi nforr.ation fc 
decisic ... ir.g, but alsc o provide explanator; ver. 

Prc"v... 69), after :3ncluding that quasi- -^e rimer.tal r-'.s were 

inappli evaluations of new programs, dc ated a rrc-del . r 

analyzi- . . >. -epancies between program definitic and program 
installs::!.- n In this model, the goal of evalua-icn was to deter.jine 
whether to :nprovG, maintain, or terminate a giv u program. The method 
may be bri 1 summarize- as; a) define program standards; b) 1^ : for a 
discrepan: uween observations about the program and the s^and rds for 
that prog c) use the discrepancy information as feedback to :he 

program d lopers. The model is useful .in program development , bur in 
the summa.ive role it could be criticized for not using comparison 
groups. :hout comparison groups we cannot conclude that the program 
is different from or better than other programs. 

At this point, we seem to arrive at an awareness that what is needed 
is a hybrid of the summative and the formative, some kind of 
quasi-experiment which includes process measures. Wittrock (1970), for 
example, criticized evaluations which measured only the end behaviors 
and not the process characteristics of the environment, the teachers, 
the learners, and the school as a social system. Schwab (1969) said; 
"What is wanted is a totally new and extensive pattern of empirical 
study of classroom action and reaction; a study, not as basis for 
theoretical concerns about the nature of the teaching or learning 
process, but as a basis for beginning to know what we are doing, and to 
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what effect-'what changes are need-:„i, which needed c.::i:iges can be 
instituted with what costs or econi.r.ies , and how they can be effected 
with minimum tearing of the remain_ng fabric of educarional effort." 

In spite of this growing aw^areri33s of the need to srudy processes in 
order to account for outcomes, act;, il evaluations cf school programs 
typically continued to concentrate : ourcomes (usual achievement 
alone). Actual attention was paid : orocess v^riL)]- in such areas as 
research on teaching TRosenshine a:.:: ui^t, 1973; Anderson, Evertson, 
and Brophy, 1979); bur these studi :till were conducted in controlled 
settings where training and manip-L^a^ion of teacher behavior were done 
and a particular treatment or in?^ ru. rional model was imposed, a 
strategy which is rarely feasibl in program evaluations. 

One notable attempt to achie- i experimental cor :itions in the 
evaluation of whole programs was ::he Follow Throug:: program. Beginning 
in 1967, Follow Through was inte :ded as a strategy for intensifying 
compensatory education, thereby amplifying effects. At the same time it 
was an attempt to. improve evaluaizion s xnce it was conceived as a planned 
variation experiment which systematically woui '. ^;ompare pupils enrolled 
in different Follow Through models of early childhood education to each 
other and to pupils from non-Follow Through classes to determine which 
models were best TKaney, 1977). 

The major and least disputable finding of the Follow Through 
evaluation was that inters ite variation was more important to 
achievement rhan was variation between models. In other words, the 
unique features of the local settings had more effects on test scores 
than did the Follow Through models. The evaluation was unable to 
conclusively determine which models were best (House, 1978). 

Kennedy (1978) concluded that two of the strongest reasons for the 



failure to find differential model effects were: 1) tests that did not 
:ually reflect the goals of all the models; and 2) failure to 
-equately verify the implementation of models. As was observed 
..rlier, the failure to verify treatment results in an inability to 
:-?.clude that an experiment actually took place. Therefore, Follow 
Through showed clearly the need for treatment verification in program 
evaluations which involve quasi-experimental designs. When one 
considers the myriad of factors that comprise the implementation of a 
treatment and the fact that each curriculum combines some or all of 
these fact->rs in greater or lesser degrees in response to its own 
particular social and educational context, one begins to realize the 
complexity and difficulty of documenting differences. To simplify the 
evaluation task, House (1978) concluded that massive experiments with 
narrow outcome measures are no longer needed. The alternative is to do 
smaller studies employing rigorous methodology and having multiple 
measures of processes and outcomes. 

THE METHODOLOGY OF TREATMENT VERIFICATION 

The inability to make causal attributions for findings of "effect" 
or "no effect" in program evaluations has increasingly led to inquiry 
into what Cooley (1978) calls "explanatory observational studies." An 
observational study involves the collection and analysis of data for the 
purpose of describing what conditions exist and telling how much they 
exist. An explanatory study involves the inclusion of causal hypotheses 
and data which attempt to explain why the observed conditions exist 
(Wold, 1956). Cooley delineated the critical features of explanatory 
observational studies under the following three topics: 



1. The sampling framework, which affects the generalizability of 
the observed relationships. 

2. The theoretical model, which describes the hypothesized causal 
structure of the variables under consideration. 

3. The statistical procedures, which are used to analyze the 
network of observed relationships for the purpose of 
establishing the plausibility of the theoretical model and 
estimating its parameters (Cooley, 1978, p. 10). 

The Sampling Framework . In discussing the sampling framework, 
Cooley identifies "two branches*^ in the literature on observational 
studies. Of the one which he refers to as "multi-population," he says: 
"One branch, exemplified by the writings of Cochran (1965) and others 
(e.g. Lord, 1960; Kenny, 1975; Overall and Woodward, 1975), deals with 
mu It i -population observational studies, in which different samples are 
administered different treatments, but random assignment of subjects to 
treatments is absent" (1978). A good example of this type of study is 
Follow Through because different sample groups chose different models 
(no random assignment) and implemented them as part of the Follow 
Through program (intervention with different treatments). 

In contrast to these "multi-population" studies are observational 
studies that involve a "single population" (e.g. Wold, 1956; Wiley and 
Hornik, 1973). Cooley says: "in such studies, one defines a population, 
draws a sample from it, and studies the relationships among variables 
measured on that sample" (1978). The multi-population design of Follow 
Through had problems because it did not draw a representative sample of 
schools and did not randomly assign schools to treatments, thus losing 
both external and internal validity. 
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The Theoretical Model . The need for theoretical models is founded 
in the need for an explanation of the causes of observed effects. 
Scientists, policy-makers, and the general public are not satisfied with 
a mere description of a phenomenon. We want to know why it exists. In 
quasi-experiments , of course, we cannot make clear and certain causal 
attributions, but we can provide data which tend to confirm or fail to 
confirm hypothesized causal explanations. 

Every program has a theoretical causal model, even if that model is 
vague or implicit. It is ^the job of the program evaluator to be sure 
that the causal model is clearly specified so thar he may construct 
clear, falsifiable hypotheses regarding causality. The causal model and 
its consequent hypotheses will serve to guide the design of the study, 
the sources of data, the procedures for collecting data, and the 
procedures for analyzing data. 

The Statistical Procedures . The statistical procedures are the 
means for providing quantitative information which confirms or fails to 
confirm the plausibility of the theoretical model. In program 
evaluations it is unlikely to have a single variable which will enable a 
crucial test of a hypothesis. Rather, many variables must usually be 
examined in an effort to assess the various program processes and 
outcomes. Therefore, the statistical procedures should be appropriate 
for the theoretical model. In explanatory observational studies, for 
example, multiple regression has been shown to have convincing 
applications in making causal inferences (Leinhardt, 1980). 
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PROBLEM TO BE INVESTIGATED 

Child Parent Centers (CPC) have been established in certain 
disadvantaged areas of Chicago to provide systematic educational 
experiences for preschool children starting as young as three years of 
age and continuing through age cycle eight. The pre-school children 
(age 3 through kindergarten) are taught in half-day sessions in centers 
affiliated with but in buildings separate from a Chicago Public 
Elementary School. The pre-school classes are called CPC's. A room in 
each center is designated a "parents' room," and class size is 15. The 
first through third grade classes are held in specially designated 
classrooms in the main building of the sponsoring public school. These 
clasrrooms are called Child Parent Expansion (CPX) classes. They arc 
intended to receive the same services as CPC classrooms, but no parent 
room is provided, and class size is 25. This paper will refer to both 
types of classroom as CPC's unless it is necessary to distinguish 
between them. 

The distinguishing characteristics of CPC's are their emphasis on 
parent involvement and on a structured language/basic skills curriculum. 

The rationale underlying the CPC's is fundamentally similar to that 
of other early childhood compensatory education programs, most notably 
Head St art and Follow Through. Like these, two massive programs, the CPC 
intends to break the cycle of poverty through an early (age. three 
through eight), irtense, systematic, and continuous educational 
intervention. The CPC's provide the following materials and services: 
1. Parents or guardians are asked to spend the equivalent of two 
days (four half-days) a month at the center because parent 
participation is considered an integral part of the curriculum 
design. 
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2. 



Half-day classes are held for an average membership of 



seventeen pupils per class, age three through kindergarten. 



3. Full-day classes are held for an average membership of 
twenty-five pupils per class, grade one through grade three. 

4. Audiovisual equipment and culturally oriented materials, geared 
to the levels of the participating pupils, are in all of the 
centers . 

5. Pupils participating in the activity in the morning session are 
provided with a breakfast and lunch at the center, and pupils 
attending the afternoon session are served a snack. 

6. The centers are administered by the principal of the parent 
school to which the CPC is affiliated, 

7. Each center is assigned one teacher and one teacher aide for 
each class, 

8. Each center is also assigned the following: a parent-resource 
teacher, a school and community representative, a school clerk, 
and a janitor. One head teacher, freed of classroom duties, is 
provided at each center. 

9. The centers share the services of speech therapists, social 
workers, school nurses, licensed practical nurses, and health 
aides with the affiliated schools. 



The treatment verification study of Chicago Child Parent Centers had 



--To verify that CPC treatment is significantly different from the 
conventional treatment . 



THE RESEARCH DESIGN AND FINDINGS 



three goals: 
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--To verify that CPC treatment is being implemented as intended. 
--To provide information which supports or fails to support the 
hypothesis that program outcomes are due to differences in 
program treatments. 

To accomplish these goals, the three issues addressed by Cooley 
(1978) were reiterated here. 

The Sampling Framework and Data Collection . The sample population 
of the treatment verification study was composed of classrooms of 
students from two age cohorts (age cycle 5 and age cycle 8) in four 
CPC^s and affiliated public schools without CPC*s. The students from 
the conventional schools served as controls. All schools were located 
in the same school district and served similar disadvantaged populations 
of whom the overwhelming majority was black (Table 1). 

Data for the classroom treatment component were collected through 
observations of 43 randomly selected classrooms from CPC*s and 
comparison schools. The observations were made by 22 faculty and 
graduate assistants of the College of Education. 43 observations were 
made: 25 in conventional classrooms and 18 in CPC classrooms. The 
instrument used was a modified version of the "Classroom Observation 
Rating Scale" developed by Walberg and Thomas (1974). It was 
hypothesized that these scales would tap important processes which were 
intended by CPC program goals. 

It was believed that the CORS was appropriate for this evaluation 
because the themes covered by the CORS were similar to the intended 
processes of the CPC program. The CORS focuses upon the following eight 
themes (Walberg and Thomas, 1974). 

1. Instruction. This theme is characterized by a very high degree 
of individual instruction and interaction. This is intended by the 
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reduced class size of the CFC and the presence of a teacher aide. 

2. Provisioning. A wealth and diversity of manipulative materials 
and books are ^ivident, not just a set for the entire class. Children 
move freely about the room, chat and assist one another. 

3. Diagnosis and 4. Evaluation. The teacher's involvement as an, 
observer. The CPC program employs a highly structured basic skills 
program which allows students to work at their own pace while 
simultaneously allowing for immediate feedback and evaluation. The 
program does not see structured learning experiences as being opposed to 
individualized, child-centered learning . 

5. Humaneness. The teacher's use of pupil's work and materials. 
This theme reflects again the CPC's emphasis on improving the richness 
of the environment as well as on valuing the child as a person. 

6. Seeking. The teacher seeks community resources, receives 
assistance from and exchanges insights with colleagues and other 
resource persons. This theme reflects the CPC's concern for community, 
especially parent, involvement. 

7. Self -perception. The teacher's self-view is of an adaptable, 
sensitive, feeling, continual learner who is comfortable with children 
taking the initiative and who trusts their ability to learn in a 
framework not centered on the teacher. 

8. Assumptions. The teacher sees knowledge as a personal synthesis 
that cannot be "transmitted." 

In an effort to delineate separate processes of the CPC program. 
Four scales were composed a priori from the CORS. The scales were: 1) 
enriched environment 2) child-centeredness , 3) parent involvement (six 
items composed specifically for the CPC study which were substituted for 
original CORS items), and 4) presence of evaluation of student 
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achievement. See Appendix A. 

k so parent involvement in the school pro^^ram was assessed by using 
paren* self-reports from parent interviews given to a random sample of 
treatment and comparison group parents. 

A Theoretical Model for the CPC The CPC model (Figure 1) for 
improving academic achievement assumes that criterion performance of 
students on achievement tests is affected by the following variables: 
--Parent involvement in the school program 

(measured by parent self-reports and the CORS '^parent involvement" scale) 
--A highly structured basic skills program (measured by 

the CORS "evaluation" scale) 
--An abundant supply of learning materials (measured by 

the CORS "enriched environmei..c" scale) 
--A reduced class size, which is intended to allow 

increased individualization and increased interaction with 
the teacher and teacher-aide (measured by 
the CORS "child-centeredness" scale) 
It should be noted that the "child-centeredness" scale incorporates 
qualities such as humaneness and freedom, which are a vague intention of 
stated CPC objectives and, it is assumed, are intended to increase with 
a lowered teacher-pupil ratio. If these qualities were found to be 
negatively associated with CPC treatment, the "child-centeredness" scale 
would be a check on unintended outcomes of the program (Cronbach, 1963; 
Talmage and Rasher, 1980). 

This model is similar to the "Model of Classroom Processes" (Cooley 
and Lohnes, 1976) insofar as it focuses upon classroom processes (Figure 
2), but it is unique in that it includes and emphasizes the efficacy of 
parent involvement in affecting home environment and student 
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achievement Because of this, the model crosses units of analysis--the 
classroom and the home (via parent inv^olvement in the school program). 
Therefore . measures of classroom processes and parent involvement must 
be incluc d in the treatment verification study and the outcome measures 
should include achievement and home environment. "improved nutrition 
and health care" is a component which was included in CPC objectives, 
but it was not quantitatively measured in this study because it was not 
clearly stated how the CPC program of nutrition and health care is an 
improvement over that of regular public schools. 

Statistical Procedures . In designing a plan for statistical 
analysis of the data, it was necessary to refer to the goals of the 
study and the CPC model. The first goal was: to verify that CPC 
treatment is significantly different from conventional treatment. This 
study examined two aspects of treatment--classroom processes and parent 
involvement in the school program. 

1.. Classroom processes. The "Classroom Observation Rating Scale" 
(Walberg and Thomas, 1974) was used to assess classroom treatment. Four 
scales were delineated a priori from the CORS : 1) enriched environment; 
2) child-centeredness ; 3) parent involvement; and 4) presence of 
evaluation of student achievement. See Appendix A. Measures of 
differences in classroom environment were obtained using discriminant 
analysis . 

The purpose of discriminant analysis is to classify phenomena 
accc rding to how well their characteristics fit the clearly specified 
characteristics of a phenomenon of interest. Theoretically, CPC's 
should differ from regular classrooms on the four a priori scales, with 
CPC's scoring higher on all four. 

The discriminant analysis showed that two scales of the CORS 
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discriminated with statistical signif icance-^-^the presence of evaluation 
of student activities" (p<.03); and "child-centeredness" (p<.05). The 
CORS did not discriminate between groups on "enriched environment" 
(p<.15) or on "parent involvement" (p<.35). See Table 2, 

Another finding was that group means of CPX classrooms were higher 
than those of CPC classrooms on all four scales and that the group means 
of CPC classrooms were higher than those of regular classrooms on all 
four scales (Table 3). This indicates that all findings are in the 
hypothesized direction and that CPX treatment would appear even more 
intensive than CPC treatment. The percent of "grouped" cases correctly 
classified was 58%. 

After completing this analysis, the authors realized that they also 
wanted to know how well the scales discriminated between regular 
classrooms and CPC/CPX classrooms combined. Therefore, another 
discriminant analysis was conducted with two treatment groups, regular 
(coded 1) and CPC/CPX (coded 2) . In this analysis the "presence of 
evaluation of student activities" scale was significant at the .007 
level and the "child-centeredness" scale was significant at .04 with the 
remaining two scales being non-significant again. With two groups the 
percentage of "grouped" cases correctly classified was 77%. 
Discrimination improved on all scales. 

Since it was noticed that the scales comprised of items from the 
original Walberg and Thomas instrument were, highly correlated with each 
other and uncorrelated with the "parent involvement" scale, it was 
decided to test how well the total of those items would predict combined 
CPC/CPX vs. comparison group membership. To do this, treatment was 
regressed on the total of the original CORS items, deleting the six 
"parent involvement" items. This resulted in a beta of .38 for the CPC 
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group (p<.001). The CORS items predicted group membership with 
statistical significance. In addition the residual plot shows that the 
residual distribution is relatively unbiased and efficient. 

Finally a factor 'analysis was done which yielded fundamentally the 
same information as did the discriminant analysis. There was one 
principal factor on which "evaluation," "chi Id-centeredness , " and 
"enriched environment" loaded heavily, and on which "parent involvement" 
was weak. 

2. Parent involvement. In further assessing parent involvement, a 
random sample of CPC and comparison group parents were asked the 
following two questions: 

1. How often do you come to (name of school or CPC)? 

A. Almost every day 

B. Often (a few times each week) 

C. Sometimes (about once each week) 

D. Once or twice each month 

E. Seldom or never 



2. Are you a member of a School Advisory Council, Parent Council, 
P.T.A., or other school-related organization? 

A. Yes 

B. No 



Question 1. was coded 1 to 5 as frequency of attendance incr-'-ased and 
was named "attendance." Question 2 was coded: yes=l, no=0; ^nd was 
named ^organization membership." Correlation coefficients were obtained 
for both scales and treatment (Table 4). From the table, i:. can be l en 
that CPC treatment is positively and significantly correlated with 
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attendance and organization membership. 

To increase precision in the estimate of the contribution of CPC 
treatment to increased attendance, a mu:' \e regression analysis of 



(p<.05) predictor. 

The second goal of the study was to vera../ that CPC treatment is 
being implemented as intended. This analysis made a logical comparison 
of intended program processes as represented in the CPC program model 
(Figure 1) with the results of the statistical analyses which represent 
the actual processes which were observed. An analysis was done to 
determine the congruence between intended and observed processes (Stake, 
1967), Figure 3 shows that CPC classes and parents scored higher on all 
intended processes, but that only the "child-cent eredness*' and 
"evaluation** scales showed statistically significant differences. 

The third goal of this study was to provide information which 
supports or fails to support the hypothesis that program outcomes are 
due to differences in program treatments. It was not possible to 
complete this analysis for this paper, but to test this hypothesis, an 
additional regression analysis will be conducted which first regresses 
achievement on a dummy variable representing CPC vs. comparison group 
exposure with the effects of pre-treatment achiever-^ent held constant. 
Followrng this initial analysis, those treatment verification measures 
significantly differentiating the CPC ' s from the comparison group will 
be added to the equation. It is hypothesized that with rhe treatment 
verification scales in the equation the dummy variable representing 
treatment will become non-significant. Such a finding would support the 
hypothesis that differences in the classroom experiences of CPC vs. 



covariance was done regressing CPC tren; 



t:t( ndance controlling 



for organization membership. CPC treatr 



ain^-.i a significant 
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comparison groups account for a majority of the treatment effect 
(Pascarella and Terenzini, 1980). 

A few words should be said about i/ ^ernal validity. Are we 
accurately measuring what wc intend to measure? As an observational 
study, the CPC research has :he advantage of studying 

naturally-occurring, well-established programs. This factor provides a 
theoretical basis for ruling out ^^Hawthorne effects" since the CPC 
treatments are no longer viewed as fresh and experimental. As a single 
population observational study with a well-defined, homogeneous 
population, the CPC study does not concern itself with random 
assignment; rather it must be concerned with methods of selection to 
ensure internal validity. Since the entire population of five and 
8-year-olds was chosen for the study and random selection was employed 
in selecting parents and classrooms, internal validity should be high. 

SIGNIFICANCE 

Regarding i:he evaluation needs of compensatory education programs 
requiring parent involvement, Ira J. Gordon, who waG a leading expert on 
parent involvement in compensatory education, emphasized the need for 
verification of treatment when he said: **The Parent Education Follow 
Through Model has influenced parents, children, schools, school systems, 
and communities. Unfortunately, information such as that presented here 
has been overlooked in policymaking at the federal level. In our 
opinion, if federal guidelines require parental involvement, the 
evaluation of the implementation of guidelines should be required" 
(Gordon, 1979). If such evaluations are to be effective, appropriate 
methodology must be improved and applied. 
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A number of evaluations of the educational effects of the Chicago 
CPC*s have been conducted (Stenner, 1974; Eash and Rasher, 1976: Fuerst, 
1977). These evaluations share a number of weaknesses common to studies 
of compensatory education programs , specifically : 

--They have been cross-sectional, one-shot studies which lacked 
meaningful measures of prior student achievement (Stenner had 
longitudinal data but did not control for prior achievement in 
estimating treatment effects). 
--They have lacked comparison groups, relying instead on 

comparisons with national norms, without control groups it has 
bee difficult to attribute effects unambiguously to the CPC 
experience . 

--They have analyzed achievement outcomes almost exclusively, 

neglecting other important components of learning such as home 

environment and locus of control . 
--They have generally failed to document the nature of or the 

degree of implementation of CPC treatment versus conventional 

treatment . 

This research intends to address these weaknesses by using 
comparison groups, by using multiple measures to verify treatment, by 
making use of prior achievement data ::o make causal attributions, and by 
employing appropriate statistical procedures. 

There is a continuing need for evaluative data to inform the 
practice of and to guide funding in compensatory education programs 
having parent involvement. As an established and ongoing program 
emphasizing parent involvement in compensatory education, the Chicago 
Child Parent Center program is an appropriate subject for this research. 
The treatments of CPC^s as well as the effects need to be assessed if 
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educational contributionfj from this large investment of time, capital, 
and human energy are to be extended to a larger population. 
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Table 1 



Student Racial Composition and Percentage of Students 
from Low Income Homes for Schools Included in the 
Evaluation of Child Parent Centers 







Percent Black^ 


Percent Low 
Income^ 


A. 


Sponsor school with CPC 


99 


83.27 


B. 


Sponsor school with CPC 


74 


66.76 


C. 


Sponsor school with CPC 


99 


54.07 


D. 


Sponsor school with CPC 


99 


60.26 


E. 


Comparison school 


100 


72.01 


F. 


Comparison school 


100 


66.47 



^Demographic data from Selected School Characteristics 1973/74 - 1977/78; 
Prepared by the Department of Administration. 



^Percentage of students from Low Income Homes. The percentage indicated 
is based on the information in the Annual Full Enrollment and Housing Report. 
The data are determined by federal census data and the percent from low 
income families as reported by the State of Illinois. 



Table 2 

Statistical Significance of the Discriminating 
Ability of the Four A Prio ri Scales of the CORS 

SCALE SIGNIFICANCE (p<) 



Enriched Environment .16 

Child-centeredness . 05 

Parent Involvement .35 
Evaluation of 

Student Activities .03 



Table 3 

Group means of Regular, CPC, and CPX Classrooms 
on the Four A Priori Scales of the CORS 



SCALE Regular CPC CPX 

Mean Mean Mean 

. (N=25) (N=13) (N=5) 

Enriched Environment 27.6 29.2 32.4 

Child-centeredness 41.9 45.5 51.2 

Parent Involvement 7 8.2 8.6 

Evaluation of 

Student Activities 14.2 18.0 19.6 
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Table 4 



Correlation Coefficients and Significance 
Levels of CT.'C Kembership, Attendance, and Organization Meinbership 



CPC 
Membership 



Attendance 



Attendance 



Organization 
Membership 



.30 
p <.009 

N=78 

.22 

p < .05 
N=83 



.41 
p <C.0002 
N=78 
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Figure 3 

A Logical Analysis of Congruence between CPC Intents 
and the Findings of the Treatment Verification Study 



INTENTS 



OBSERVATIONS 



Reduced class size which 
should foster increased 
individualization and 
increased interaction with 
teacher and teacher-aide 
(measured by the "chi Id- 
cent eredness" scale) 



CPC classes scored significantly 
higher on the '^child-centeredness" 
scale (p<.05) 



Highly structured basic 
skills program (measured 
by the "evaluation" scale) 



CPC classes scored significantly 
higher on the "evaluation" 
scale (p<.03) 



Provisioning for abundant 
materials (measured by the 
"enriched environment" scale) 



CPC classes scored higher on 
the "enriched environment" scale 
(p<.15) 



Parent involvement (measured 
by the "parent involvement" 
scale and parent self-reports 
of ''attendance" and "organization 
membership") 



CPC classes scored higher on the 
"parent involvement" scale (p<.35). 
CPC parents reported higher 
"attendance" (p<. 009) and 
"organization membership" (p<.05) . 
CPC parents remained significantly 
higher on "attendance" (p<.05) 
when "organization membership" was 
used as a covariate. 




APPENDIX—A 



A list of the items in the a_ priori scales taken from the "Classroom 
Observation Rating Scale" (Walberg and Thomas, 1974); and the "parent 
involvement" scale constructed specifically for the CPC Study. 
Uncodod items were not included in the four a priori scales. 



Scale codes: 



OBSERVATIOU-RATING SCALE 



EN=" enriched environment" 
CC="child--centeredness" 
EV=" evaluation" 
PI="parent involvement" 
(R)=Rating scale value is reversed 

(e.g. a value of "4" is scored as "1") 

E^r 1- Texts and materials are supplied in class sets 
so that all children may have their own. 
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EN Each child has a space for his/her personal storage 

and the major part of the classroom is organized 
for common use. 



EN 3, Materials are kept out of the way until they are 
(R) distributed or used under the teacher's 

direction . 



EN 4. Many different activities go on simultaneously. 



CC 5. Children are expected to do their own work 
(R) without getting help from other children. 



PI 6. There are parents present in the cla 



ssroom. 



EN 7. Manipulative materials are supplied in great 
diversity and range, with little replication. 



CC 8. Day is divided into large blocks of time 
within which children, with the teacher's 
help, determine their own routine. 



CC 9- Children work individually and in small groups 
at various activities. 



EN 10. Books are supplied in diversity and profusion 
(including reference, children's literature). 



CC 11. Children are not supposed to move about the room 
without asking permission, 
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12. Desks are arranged so that every child can see 
the blackboard or teacher from his/her desk. 



EN 13. The environment includes materials developed 
by the teacher. 



PI 14. Parents are working with small groups of children, 
15. The program includes use of the neighborhood. 



EN 16. Children use "books" written by their class- 
mates as part of their reading and reference 
materials. 



CC 17. Teacher prefers that children not talk when they 12 3 4 

(R) are supposed to be working. 



CC 18. Children volmtarily group and regroup them- 
selves. 



EN 19. The environment includes materials developed or 12 3 4 

supplied by the children. 



CC 20. Teacher plans and schedules the children's 
(R) activities through the day. 



PI 21. The environment includes materials developed or 
supplied by parents. 



CC 22. Teacher makes sure children use materials only 
(R) as instructed. 



CC 23. Teacher groups children for lessons directed at 
specific needs. 



CC 24. Children work directly with manipulative mater- 
ials. 
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APPENDIX— A~3 



EN 



25. Materials are readily accessible to children, 



pj 26. The environment includes materials for 
parents to read and/or use. 
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27. Teacher promotes a purposeful atmosphere by 
expecting and enabling children to use time 
productively and to value their work and learning. 



Ev 28. Teacher uses test results to group children for 
reading and/or math. 



CC 29. Children expect the teacher to correct all 
(R) their work. 



CC 30. Teacher bases instruction on each individual 

child and his/her interaction with materials and 
equipment. 



EV 31* Teacher gives children tests to find out 
what they know. 



32. The emotional clijnate is warm and accepting. 



33. The work children do is divided into subject 
matter areas. 



PI 34. The teacher works cooperatively with parents 
in the room. 



CC 35. The teacher's lessons and assignments are given 
(R) to the class as a >diole. 



CC 36. Teacher bases instruction on textbooks for. the 
(R) grade level he/she teaches. 



37. Teacher has children for a period of just one year. 1 
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38. The class operates within clear guidelines 
made explicit. 

QQ 39. Teacher takes care of dealing with conflicts 
and disruptive behavior without involving 
the group. 

EN "^0- Children's activities, products, and ideas are 
reflected abundantly about the classroom. 



QQ 41. The teacher is in charge. 
(R) 

Ev 42. Before suggesting any extension or redirection 
of activity, teacher gives diagnostic attention 
to the particular child and his/her particular 
activity. 



QQ 43. The children spontaneously look at and discuss 
each other's work. 



EV Teacher uses tests to evaluate children and rate 

them in comparison to their peers. 



QQ 45. Teacher uses the assistance of someone in a 
supportive, advisory capacity. 



CC 46. Teacher tries to keep all children within his/her 
(R) sight in order to make sure they arc doing 

what they are supposed to do. 



EV 47. Teacher keeps a collection of each child's work for 1 
use in evaluating his /her development. 



EV 48. Teacher views evaluation as information to 
guide instruction and provisioning for the 
classrcxDm. 



CC 49. Academic achievement is the teacher's top priority 12 3 

(R) for the children. 

CC 50. Children are deeply involved in what they are 12 3 

doing . 
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INVOLVEMENT 



Figure 1 : A Theoretical Model for the CPC. 



Mode! of Classroom Processes. 




Events 



Figure 2 : Model of Classroom Processes. 
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